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Abstract 

This paper discusses the use of the scalp electric field to decode EEG-recorded 
brain processes. Instead of using bipolar measurements, the scalp electric field 
is described as a 3-vector field whose orthogonal components are obtained from 
the data through spline differentiation. The method was tested in the context of 
brainwave recognition with experiments involving brain representation of spoken 
phonemes, visual images, and mental images. The practical effect of improve- 
ments in recognition rates was assessed by estimating effect sizes and confidence 
intervals, the results suggesting a good prospect for other applications. 



Introduction 



Performing the surface Laplacian differentiation of scalp potentials has proved to be 
an efficient method to circumvent reference issues which may strongly influence co- 
herence estimations of EEG signals (Hjorth 1975 Perrin et al 1989[ l. Additionally, 
many studies suggested that dura-surface potential is more accurately represented us- 
ing surface-Laplacian topography rather than conventional topography ( [Nunez and Pil-| 
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greenj 11991] [Nunez et il)! 1991 [[Nunez and Westdorp[ [1994] [Nunez e"tiIl|1994[|Srini- 



vasan et al 1996 Nunez and Srinivasan 2006 1. This has motivated a number of exper- 



imental studies of both clinical and theoretical interest, such as those of [Babiloni et al| 
( [T999| [2000] [200T] [2002| ; [Chen et al[ ( p005] l; [Kayser and Tenke[ ( |2006a|b| ); [BaTeFar 



(2008 1; Besio et al ( 2009| l. Yet, despite the its broad success, we show in this paper 
that the surface-Laplacian differentiation gives an incomplete description of the phys- 
ical process underlying EEG, in the sense that it corresponds to an approximation for 
the normal component of the scalp electric field. But in addition to the field's normal 
component, tangential components are potentially a valuable resource to supplement 
and enhance information not encoded in the surface-Laplacian differentiation. Based 
on this consideration, the scalp electric field is thereby regarded as the central quan- 
tity for overall assessment of the data content. Therefore, the estimation of the scalp 
electric field from empirical data is the principal subject of our current work. 

At first glance, this seems not to be a new topic. Bipolar records over closely-spaced 
scalp sites have long been used to circumvent reference channel effects, and they are 
closely related to the value of the electric field along the scalp surface. This measure, 
however, leaves out the field's normal component that arises when resistive electrodes 
are attached to the scalp in order to acquire the signal. Our approach takes this com- 
ponent into account and fully reconstructs the scalp electric field as a 3-vector field at 
measuring sites. More importantly, our results consistently emphasize the significance 
of this full estimation to achieve optimal results. 

We used splines to perform efficiently spatial differentiations to obtain the field 
components. As an application, we considered three experiments of brain-wave repre- 
sentation for which the effectiveness of the scalp electric field to improve recognition 
rates was statistically evaluated. These experiments involved brain processing of (J) 
spoken phonemes in consonant-vowel format; (//) two-dimensional images of geomet- 
ric shapes (circle, square, and triangle) filled in with different colors (red, green, and 
blue); and (Hi) mental images in response to hear a "go" sound or view a "stop" sign 
on a computer screen. We used effect sizes with 95% confidence intervals to estimate 
the practical significance of improvements, yielding an optimistic prospect for further 
developments and applications of the proposed technique. 
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Methods 



Experimental Procedures 

We refer to the three experiments used in our study as Exp. I, Exp. II, and Exp. III. 
Briefly, Exp. I consisted of auditory presentations of 32 consonant-vowel syllables; 
Exp. II focused on the brain representation of 9 images formed from pairwise combi- 
nations of three shapes (circle, square, and triangle) and three colors (red, green, and 
blue); and Exp. Ill was a two-class imaginary task performed right after a stimulus pre- 
sentation. These experiments were conducted on-site in our Laboratory motivated by 
different scientific purposes. The subjects who voluntarily took part in each experiment 
were all healthy adults who reported normal hearing, normal or correct-to-normal vi- 
sion, and normal color vision. They were labeled as SI, S2, S3, • • • , but participant SI 
of Exp. I was not necessarily the same as participant S 1 of Exp. II, and so on. 



Exp. I: 32 consonant-vowel syllables 

This experiment emerged from Rui Wang's doctoral work ( |Wang[[2011| l and appeared 
recently in Wang et al ( 2012| l. The focus was on the identification of brain patterns 
induced by auditory syllable stimuli. EEG data were recorded from 4 participants (Sl- 
S4), 1 male, who were engaged in the discrimination of 32 English syllables formed 
from pairwise combinations of the 8 consonants /p/, /t/, Ibl, /g/, Ifl, /s/, /v/, /z/, and 4 
vowels III (as in meet), /ae/ (cat), /u/ (soon), and /a/ (spa). These vowels were selected to 
facilitate recognition, as they are maximally separated in the American-English vowel 
space. The sounds of the syllables were uttered by a male native speaker of English, 
with 7 recordings being made for each syllable to create a diversity of speech signal. 
Participants were instructed to carefully listen to the spoken words and try to compre- 
hend them, but no response was required. The stimuli were randomly presented via a 
computer speaker in sessions of 1000-ms trials. Each session lasted 15 minutes and 
consisted of 28 repetitions of each syllable, amounting to 896 trials per session. A total 
of 7,168 trials (8 sessions) were collected for participant SI; 3,584 (4 sessions) for S2; 
6,272 (7 sessions) for S3; and 4,480 (5 sessions) for S4. There was a short break after 
each block of 56 trials, and the participant could control the length of the break by 
pressing the spacebar. 
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Exp. n: 9 shape-color images 



This not-yet-published experiment, performed by researchers at the Suppes Brain Lab 
(P. Suppes, M. P. Guimaraes, and ???), tested the recognition of brain-wave representa- 
tions of nine two-dimensional images, formed by pairwise combining three geometric 
shapes (circle, square, and triangle) and three colors (red, green, and blue). The re- 
searchers presented randomly these images to seven participants (S 1-S7), three female, 
on a 17-inch computer screen against a dark backgroimd. The area of each shape was 
approximately the same, and the physical luminosity was adjusted for each object and 
color to appear the same at one meter from the screen. No attempt was made to ad- 
just images to each participant, such that the subjective perception of luminosity was 
the same for all colors and each participant. Each presentation lasted 300 ms with an 
inter-stimulus interval of 1000 ms. A white fix point ('+') lasting 700 ms was shown 
at the center of a blank screen, immediately after the presentation. Participants were 
instructed to remain relaxed and motionless, and to keep their eyes fixed at the center 
of the screen during presentations. In total 2,700 trials were performed per participant, 
with stimuli randomly appearing on the screen with equal probability. The presenta- 
tions were divided in blocks of 20 trials and the participant could control the duration 
of the breaks via the spacebar. Halfway through the experiment a modified break mes- 
sage was displayed informing the participant that the experiment had passed its half 
point. 




P09 Oz PO10 

09 O10 



Figure 1: Electrode montage used in Experiment II. 
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Exp. Ill: 2-class imagery task 



The third experiment was previously described in detail in Carvalhaes et al ( 2009 1; 
|Carvalhaes and Suppes| ( [20lT| ). Eleven participants (S 1-S 11) were randomly presented 
on every other trial either a visual "stop" sign, flashed on a computer screen, or the 
sound of the English word "go", uttered by a male native speaker of English. Each 
stimulus presentation lasted 300 ms, and was followed by a period of 700 ms of blank 
screen. Immediately after this period a fixation point ('+') was showed at the center of 
the screen for 300 ms. For one group (S1-S7) the participants were instructed to form 
a vivid mental image of the stimulus previously presented, for another group (S8-S11) 
they were asked to form a mental image of the alternative stimulus, i.e., if the last 
stimulus was the "stop" sign, then they should imagine the "go" sound, and vice versa. 
Participant's imagining was followed by another 700 ms of blank screen, after which 
the trial ended. A single session of 600 trials was recorded for each participant. The 
session was divided into thirty 20-trial blocks, with regular breaks controlled by the 
participant via spacebar. Each trial lasted 2,000 ms, but only the last 1,000 ms of each 
trial corresponding to the imagination task was used for our analysis. 

Data collection and preprocessing 

The apparatus used to record EEG signals changed from an experiment to another. 
Exp. I was carried out using EGI's Geodesic EEG system with 128 monopolar channels 
referenced to the vertex electrode (Cz). In Exp. 11 signals were recorded using a 32- 
channel NeuroScan system with linked earlobe reference. Due to the low number of 
channels available on this device - and in view of the need for a reasonable density 
of electrodes to accurately estimate the electric field in the region of interest (VI) - 
the measurement electrodes were all placed in the back part of the head, as depicted 
in Figure[T] Exp. Ill used a 64-channel Neuroscan system, following the 5% system 



of Oostenveld and Praamstra (2001 1, but not including electrodes Nz, AFl, AF2, AF5, 
AF6, T9, TIO, P9, P5, P6, P9, PIO, PO, or I. All signals were recorded in an audio 
isolation, darkened room. After amplification, the signals were passed through a band- 
pass filter in the range 0.1 -300 Hz plus a 60 Hz notch filter The conversion into digital 
form was performed at a sampling rate of 1 kHz. 

To reduce features, we then carried out offline decimation at 16:1 ratio, thus setting 
the Nyquist frequency at 31.25 Hz. Additionally, we removed unwanted low-frequency 
components by applying a high-pass filter of 1 Hz. Finally, we mathematically refer- 
enced the decimated signals to the average reference voltage to reduce biases in the 
analysis of the potential distribution ( |Bertrand et~all|1985[ [Murray et ail|2008| l. This 
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step has no effect on the estimation of the scalp electric field, for it is a reference-free 
quantity by definition. 

In order to enhance the signal-to-noise ratio, we averaged same-class trials over 
small groups of trials before performing recognition. We fixed the number of samples 
per average trial according to the amount of classes and total number of trials available 
in the experiment. With this consideration in mind, the number of samples per average 
trial varied as follow: 12 (Exp. I, 8 initial consonants); 5 (Exp. I, 32 syllables); 20 
(Exp. I, 4 vowels); 5 (Exp. II); and 5 (Exp. III). 



Approximation for the normal component of the scalp electric field 

In conventional EEG no information about the electric potential is available along the 
direction normal to the scalp, which precludes a direct estimation of the field normal 
component. Our approach to circumvent this problem consists of an approximation 
based on the theoretical considerations explained below. 

The widely-used spherical head model is assumed for simplicity throughout this 
paper, taking the outer scalp surface as a sphere of homogeneous isotropic conductivity 
^scaip ^jjj radius rscaip- The orthogonal components describing the field are Eg,Efp, and 
£,.; two of them (Eg and E^) are tangent to the scalp and the other (E^) is normally- 
oriented. These components are obtained from the electric potential <I> by using 

1 54> 1 d<i> 

^r — ^^i ^e — --^^ E^ — ^3:7- (1) 

or rod r sm 

Note that our convention of spherical coordinates is that of |Griffiflis| ( |1999l p. 38). 
The polar angle 9 increases down from the vertex and the azimuth (p from the nasion 
counterclockwise around the vertex. 

We recall that the normal component of the electric field is subject to the condi- 
tion that its product by the electrical conductivity is constant at any interface between 



two adjacent macroscopic layers in the head (Plonsey 1969 ch. 5). For homogeneous 
layers with conductivities a' and this condition reads 

a'El.=a^El (2) 



According to this relation, any sudden change in the electrical conductivity at a tissue 
interface is accompanied by the reciprocal change of the field normal component. If we 
apply B to the scalp-air interface, and consider the negligibihty of a^"' as compared 
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to a'^'^^'P (typically (jair/^yscaip _ io-i4)^ obtain 

^scalp^scalp^Q^ (3) 

so that the field normal component is approximately zero everywhere on the outer scalp 
surface. Therefore, the scalp electric field is essentially a tangential field along the free 
scalp surface. Recalling that the scalar potential obeys Laplace's equation V^<P = 
anywhere in the extracellular region, 

Id^P d^<P 1 d f <94>\ 1 d^<P 

-:r- + ^r-^+ , . ^ ^ Sm ^ + ^ ^r— ^ = 0, (4) 



r 



or 



vLf4>=2£, + ^, (5) 
r or 



where V^^j.^ is the surface Laplacian operator and dEy/dr represents the outward nor- 
mal derivative of £, . Since eI'^^^^ is null, we obtain from (|5]l 



scalp ^ ^y. 



(6) 

scalp 



i.e., the surface Laplacian of <I> is equal to the rate of change of Er along the normal 
direction on the scalp. 

The condition (|2]) follows from the conservation of the volume current density, T , 
that flows passively in the extracellular region due to brain activation. This density is 
locally related to the electric field by Ohm's law; 

r = C7E. (7) 

It follows then that the vanishing of eI'^^'^^ confines the current flow within the head, 
i.e., y'rlscaip = 0, causing a significant increase in lateral spread of flow lines close to 
the outer scalp surface. 

The application of a conductive gel or an electrolytic solution to couple a resistive 
electrode to the scalp changes the boundary conditions locally, affecting the behavior 
of the flow lines beneath electrode sites. Now the field normal component is not con- 
strained to vanish abruptly at these sites, but instead it drives current out of the head 
into measuring device. This makes the tangential current spread less pronounced than 
along the scalp-air interface. As a consequence, the last term on the left side of Eq. (|5]l 
should reduce its importance locally. Based on this consideration, our approach to 



7 



estimate Er'^'^^ at measurement electrode sites consists of the approximation 

^-f«>Lscalp « ^^r'P- (8) 

That is, we assume that when EEG is actually recorded in the laboratory using resis- 
tive electrodes the surface Laplacian of <I> approximates to the normal component of 
the scalp electric field multiplied by the factor This approximation was used 

throughout this work and we tested its validity in the context of brain-wave recogni- 
tion. Note that in virtue of ^ the expression ([HJ locally relates V^^j.^^! scalp to the nor- 
mal component of J''. This goes some way toward supporting the usual view that the 
surface Laplacian differentiation is an accurate method to associate local EEG events 
generated by cortical radial dipoles to the underlying physical structure. However, 
the expression (|8]l has been reached without any assumption whatsoever about brain 
sources. 



Numerical procedure 



Numerical differentiations to estimate the scalp electric field from EEG data were car- 
ried out at low computational cost using splines on the spherical head model. Consider 
an instantaneous scalp potential distribution {Vi, • • • ,Vn}, sampled at electrode loca- 
tions ri , • • • jT^r at a time t. The 3D spline interpolant is the function defined by 



2m 3 

Mr) = I^c/ \\r-rj\\ + ££/i'0/;(r) 



(9) 



where m > 2 is an integer, M — (™^^) is subject lo M < N, 0i , • • • , 0m are a set of 
linearly-independent polynomials in M? of degree less than m, and cj and dj are pa- 
rameters that depend on the potential distribution. In order to avoid the magnification 
of high-frequency spatial noises, the parameters cj and dj were determined by intro- 
ducing a regularization parameter, X. This lead us to the system 



K + NU T 
T' 




(10) 



r,f"'-^ (T),-,- = <?>,-(r,-),c: 



(ci,-- • ,Civ)', d = {di,--- .du)', and 



where (K);y = ||: 

V = (Vi, • • • ,Vn)' ■ As explained in CarvaUiaes and Suppes (2011 1; Carvalhaes (2012 1, 



the system ( [TO] i is singular on a spherical surface. Following Carvalhaes and Suppes 
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( |2011[ ), we factorize T as 

T=(Qi,Q2) I " I, (11) 




where Qi e R^""^ and Q2 G R^^i^-^) are orthonormal and R e R^""^ is upper tri- 
angular, and introduce the auxihary matrices 

Ca=Q2[Q2(K + A^AI)Q2]"'q'2, (12a) 
DA=R+Q'i(l-KCA-A^AC;t), (12b) 

where R+ is the pseudo-inverse of R. Let e^, e^, and be A^-dimensional vectors 
giving the respective components of the scalp electric field at the electrode coordinates. 
These vectors can be obtained by linearly transforming v as follows: 

e^ = (KeC;i+TeD;t)v = E^, (13a) 
e^ = (K^C;L+T^DA)v = E^v, (13b) 
= (KQ +TD;,)v- (r-^'P/2)L;LV. (13c) 

The analytic expressions for the matrices Kg, Tg, Kip, T(f,, K, and T and a Matlab 
code implementation are available online in the supplementary material. We remark 
that the vector was obtained as the surface Laplacian of v following Eq. ([8]). Since 
the field components are reference-free by definition, the linear transformations ( [T3] l 
are all singular, regardless of the value of A. 

Recognition procedure 

For each experiment, we carried out channel -by-channel recognition using a 10-fold 
cross-validation on linear discriminant analysis ( |Parra et al 2008 Suppes et al 2009| l. 



We organized the data in a matrix form, with different trials occupying different rows 
and the time samples spanning the columns. To reduce temporal features from the data 
in order to optimize performance we applied Principal Component Analysis (PCA).. 
We repeated this procedure several times for that recognition for each data matrix, 
adding the principal components one by one in order of decreasing variance in the 
data. We performed this computation after determining the optimal value of A, sought 
in the range 0.001-100 in a 50-points log-scale grid. 

Our ultimate goal was to compare cross-validated rates provided by the potential 
distribution and electric field estimate. However, we found instructive to examine the 
effect of the normal and tangential components of the scalp electric field separately. 
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For that we carried out recognition using the field normal component alone, and for a 
two-vector field composed by the field tangential components. Henceforth we refer to 
these derivations simply as normal field and tangential field, respectively. We obtained 
the matrix representation of vector fields through one-by-one concatenation of trials, 
resulting in a matrix with twice (tangent field) or three times (total field) as many 
columns as the number of samples per trial. 



Statistical analysis 

We used the same random sequence of trials in the recognition of the four waveforms 
(potential, normal field, tangential field, and total field), thus giving pairwise recog- 
nition rates to compare performance. The practical effect of the electric field and its 
components was separately compared to the potential in terms of effect sizes with 95% 
confidence intervals. Effect sizes (ES) were calculated as 

■^/.pool 

where is the mean recognition rate over all participants, the index / stands for either 
normal field, tangential field, or total field, and /ipot is the mean rate for the potential. 
The pooled standard deviation .s,_pooi is defined by ii.pooi = y^C^f^-i^ot)/2, where 
is the variance and the index / is the same as above. The approximate width of the 
respective 95% confidence interval (95%C1) was given by 

95%C1= [ES- 1.96 ig,ES + 1.96 (15) 



where Sg is the asymptotic standard error between paired rates (Nakagawa and Cuthill 
[2007l l. 



Results 

Recognition rates 

Tables[T]|5]summarize the results we found for the recognition rates of each experiment. 
The highest cross-validation mean rate is shown for each participant along with the best 
sensor. In general, the rates were remarkably good bearing in mind the chance level 
of each experiment. The total electric field was the best predictor, except for Exp. Ill, 
where it performed similarly to the tangential field. 
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Table[T] shows the result for the 8-class problem in which the initial consonants of 
Exp. 1 were used as labels. The total electric field not only yielded the highest recogni- 
tion rate for all participants, but interestingly its best performance was always achieved 
on locations at the primary auditory cortex (Al). Averaged over all participants, the 
total field improved 10.6% over the potential and outperformed the field normal com- 
ponent in 4.8%. The tangential field performed similarly to the total field in average, 
but the individual rates of the total field were higher than those of the tangential field 
for all participants. 



Table 1: Highest performance for the recognition of the 8 initial consonants of 
Exp. I. 





potential 


norm. 


field 


tang. 


field 


total field 


participant 


% 


sensor 


% 


sensor 


% 


sensor 


% 


sensor 


SI 


45.2 


E36 


57.5 


E41 


60.7 


E40 


63.0 


E40,E41 


S2 


37.2 


E30 


40.5 


E12 


43.4 


E109 


44.4 


E40 


S3 


27.5 


E13,E29 


32.6 


E28 


36.0 


E47 


38.8 


E35 


S4 


31.9 


E112 


30.3 


E20 


31.9 


E122 


32.4 


E41 


Avg.istd. 


35.9±7.4 


41.7±11.9 


44.6±12.1 


46.5±12.5 


Trials per participant: SI -600, S2- 


304, S3 


-528, 


and S4-376. 


Chance 


level: 12.5°/ 


^0. 



Table|2] gives the result for the recognition of the 32 syllables of Exp. 1. The 4- 
fold increase in the number of classes as compared to the recognition of the initial 
consonants resulted in a decrease in recognition rate by almost the same factor. The 
total field once again provided the highest recognition rates, except for S4, for which it 
yielded the rate 8.1% vs. 8.2% by the tangential field. We see that the highest rates of 
both methods were achieved in the region of the secondary auditory cortex (A2). 



Table 2: Highest performance for the recognition of the 32 syllables of Exp. I. 



participant 


potential 


norm. 


, field 


tan 


g. field 


total field 


% 


sensor 


% 


sensor 


% 


sensor 


% 


sensor 


SI 


13.4 


E36 


21.4 


E41 


19.6 


E46 


23.1 


E41 


S2 


9.5 


E30 


9.9 


Cz 


10.9 


E35 


11.0 


E40 


S3 


7.8 


E13 


8.4 


E20 


9.3 


E97 


9.4 


E44,E46 


S4 


7.9 


E6,E13 


7.1 


E12 


8.2 


E116,E122 


8.1 


E116,E122 


Avg.istd. 


10.0±2.5 


12.7±6.3 


12.8±5.0 


14.0±6.7 



Trials per participant: SI -1440, S2-736, S3- 1280, and S4-897. Chance level: 3.1%. 



Table|3] summarizes the result of the recognition of the 4 vowels in Exp. 1. Despite 
the rates being significantly above chance probability (25%), the highest rate of 46.9% 
(SI) is much lower than that of the initial consonants (63%, SI), which had twice as 
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many classes. Furthermore, average improvements were not as large in average as the 
two previous cases. 



Table 3: Highest performance for the recognition of the 4 vowels of Exp. I. 



potential norm, field tang, field ' total field 



participant 


% 


sensor 


% 


sensor 


% 


sensor 


% 


sensor 


SI 


40.8 


E37 


46.4 


E42 


41.1 


E40 


46.9 


E41 


S2 


38.3 


E52 


38.3 


E80 


43.9 


E56 


43.3 


E56 


S3 


37.0 


E6 


39.6 


E127 


38.3 


E52 


38.6 


Elll 


S4 


39.6 


E76 


39.6 


E76 


44.4 


E97 


41.8 


E105 


Avg.istd. 


39.0±1.6 


41.6±3.5 


41.4±2.5 


42.8±3.4 



Trials per participant: SI -360, S2-180, S3- 316, S4-225. Chance level: 25.0%. 



Table|4] shows the recognition rates of Exp. 11. The lowest recognition rate was 
52.1% for S2 using the normal component of the scalp electric field alone. The highest 
rate 86.9% was achieved with participant S 1 using the total field. These results are re- 
markably good taking into account the chance probability of 11 . 1 %. Recognition using 
only the tangential components or the total field significantly outperformed the poten- 
tial and normal field. The normal field performed similarly to the potential in average 
(63.0% vs. 61.9%) and rendered the highest standard deviation among all methods. 



Table 4: 


Highest performance for th 


e recogn 


ition of the 9 im 


ages of Exp. II. 


participant 


potential 


norm. 


field 


tang 


. field 


total field 


% 


sensor 


% 


sensor 


% 


sensor 


% 


sensor 


SI 


72.7 


P08 


81.6 


P08 


83.2 


P04 


86.9 


P08 


S2^ 


58.2 


09 


52.1 


02 


68.0 


P04 


71.1 


02 


S3 


61.7 


POz 


60.6 


P3 


62.2 


CP2 


70.7 


P3,P4 


S4'' 


59.5 


POz 


63.9 


P08 


68.1 


02 


75.1 


P08 


S5 


66.1 


P03 


70.5 


POz 


76.2 


PI 


81.8 


POz 


S6^ 


60.3 


01 


55.9 


02 


65.8 


CP4 


70.0 


Oz 


S7^ 


54.8 


Iz 


56.6 


P2 


67.5 


P4 


70.6 


P4 


Avg.istd. 


61.9±5.9 


63.0±10.2 


70.2±7.1 


75.2±6.7 


^Channels 


CP6 an 


d P09 were 


off. I^Channel CP6 


was off. 









Trials per participant: 543 . Chance level: 11.1%. 



Table[5] shows the recognition rates for the trials of the mental task of Exp. 111. Ob- 
serve that these rates are higher than those showed in Carvalhaes and Suppes ( 201 l| l. 
The reason for this difference is because in |Carvalhaes and Suppes| ( f2011| l the recogni- 
tion was performed without averaging the trials to reduce temporal noise. Here, most 
of the best predictions were achieved by the tangential electric field (S2, S3, S4, S7, 
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S9, SIO, SI 1) rather than the total field itself, which yielded the highest rate for only 5 
participants (S3, S6, S8, S9, Sll). The normal field was the most accurate method for 
participants SI and S5. 



Table 5: Highest performance for the recognition of the mental task of Exp. III. 







potential 


norm, field 


tang 


. field 




total field 


participant 


% 


sensor 


% 


sensor 


% 


sensor 


% 


sensor 


SI 


95.9 


P8 


96.7 


P8 


95.0 


CP6 


95.9 


P8 


S2 


77.7 


FC4 


78.5 


C4 


83.5 


P3 


81.8 


PI 


S3 


81.0 


P04 


81.0 


CPz 


86.0 


P2 


86.0 


CP4 


S4 


86.7 


P7 


82.5 


Pz 


89.2 


P1,P2 


88.3 


P4,P04 


S5 


86.0 


P4 


92.6 


P4 


88.4 


CPz 


88.4 


P4 


S6 


68.3 


P7,P3,P03 


72.5 


F7,FC3 


73.3 


FT7 


74.2 


Pz 


S7 


79.3 


P03,01 


86.8 


P03 


87.6 


01 


85.1 


P3 


S8 


87.6 


01 


81.0 


C3,C6,02 


90.9 


P3 


91.7 


P03 


S9 


77.7 


C4 


76.0 


TP9,P03 


80.2 


P04 


80.2 


P04 


SIO 


88.4 


FC2,FC4 


86.8 


P3 


93.4 


CP3 


92.6 


CP3 


Sll 


82.6 


FC2 


86.0 


P7 


86.8 


CP3 


86.8 


CP5,CP3,P3 


Avg.istd. 


82.8±7.3 


83.7±7.1 


86.7±6.1 


86.4±6.1 



Trials per participant: 121. Chance level: 50%. 



Effect sizes 

We evaluated the practical significance of improvements in the recognition rates shown 
above in terms of effect sizes and 95% confidence intervals. The result is summarized 
in Table|6] The tasks of recognizing the 8 initial consonants and 32 syllables in Exp. I 
rendered nearly the same effect size. The recognition of the 4 vowels, where the devi- 
ation from the mean recognition rate was relatively small for each participant, resulted 
in effect sizes equal to or greater than one standard deviation. The effect sizes were all 
positive in Exp. II, but the confidence interval for the normal field included zero. This 
means that the hypothesis of no difference in performance between the potential and 
normal field cannot be rejected at 95% level of confidence in this case. In contrast, the 
superior performance of the total electric field as compared to the potential was con- 
firmed with 2.1 standard deviations. The effect sizes were all positive in Exp. IV, but 
again the hypothesis of no difference between the potential and the normal field cannot 
be rejected since the confidence interval includes zero. 
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Table 6: Effect sizes and 95% confidence intervals for improvements in recognition 

r ates. 

Experiment normal field tangential field total field 

Exp. I (initial consonants) 0.6 (0.4 to 0.8) 0.9 (0.6 to 1.2) 1.0 (0.7 to 1.4) 

Exp. I (syllables) 0.6 (0.4 to 0.7) 0.7 (0.5 to 0.9) 0.8 (0.6 tol.O) 

Exp. I (vowels) 1.0 (0.6 to 1.3) 1.2 (0.6 to 1.7) 1.4 (1.0 to 1.9) 

Exp. II 0.1 (-0.2 to 0.3) 1.3 (0.4 to 2.1) 2.1 (0.9 to 3.4) 

Exp. Ill 0.1 (-0.2 to 0.5) 0.6 (0.3 to 0.9) 0.5 (0.3 to 0.8) 



Effect of smoothing 

Additionally, we evaluated the possible effect of smoothing the data in the recognition 
rates. For that, the potential distribution was spatially smoothed using the same pro- 
cedure described for the scalp electric field. So, recognition was repeated 50 times for 
each participant, with the smoothing parameter A varying in the same interval that op- 
timized the performance of the electric field. However, we found no significant change 
in the rates by using this procedure. The largest effect size for the smoothed potential 
compared with raw data was 0.3 (95%CI, 0.2-0.5). This result occurred for the recog- 
nition of the 8 initial consonants (Exp. I). The other experiments rendered effect sizes 
smaller than 0.3, and the confidence interval included zero in all cases. 

Recognition with multiple channels 

We also evaluated the applicability of the electric field in multichannel recognition. For 
that, the best performing channels were concatenated in groups of 5 and 10 channels 
independently of their physical location, and the trials were then recognized using the 
same optimization procedure described above for single channels. Table]?] shows the 
resulting effect sizes. (The tables showing the recognition rates are presented in the 
supplementary material available onhne.). 

Small variations were observed in the performance of the normal field, the most 
favorable one being the monotonic increase of effect size (0.6, 0.7, 0.8) in the recog- 
nition of the 8 initial consonants. The effect of the normal field in the recognition of 
the 4 vowels changed drastically, decreasing 10 folds with using 10 channels instead 
of single channels. The practical effects of the tangential field and total field were 
strongly affected in the recognition of the vowels, shape-color images, and stop-go 
imaginations. They remained about the same in the two other cases, excepted that the 
effect of the electric field decreased from 1.0 to 0.5 in the recognition of the initial 
consonants using 10 channels. Differently from single-channel recognition, the 95% 
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confidence interval includes zero in several cases, indicating total loss of significance 
of improvements in recognition rate. 



Table 7: Effect sizes for concatenating the 5 and 10 best-performing channels. The 
columns account for the normal component (NC), the tangential components (TC), 
and the total scalp electric field (TF). 



Experiment 


Five 


channels 




Ten 


channels 


NC 


TC 


TF 


NC 


TC 


TF 


Exp. 1 (initial consonants) 


0.7 


0.8 


0.8 


0.8 


0.8 


0.5 


Exp. 1 (syllables) 


0.7 


0.6 


0.8 


0.6 


0.8 


0.6 


Exp. 1 (vowels) 


0.4 


0.1 


-0.1* 


0.1* - 


0.4* 


-0.9 


Exp. II 


-0.2* 


0.1 


0.4 


0.2* 


0.2* 


0.3* 


Exp. Ill 


0.0* - 


-0.2* - 


-0.4* 


0.1* 


0.0* 


-0.3* 


*95%CI includes zero. 



Discussion 

This work demonstrated the effectiveness of the scalp electric field in the recognition 
of brain processes represented in EEG signals. In general, the recognition accuracy of 
our experiments was higher using all components of the electric field instead of normal 
or tangential components separately. The mental task of Exp. Ill was the only case for 
which the average recognition rate of the tangential field was higher than that of the 
total electric field. 

Improvements were generally much less significant in the case of multichannel 
recognition. In general, the potential substantially improved performance with multiple 
channels, but the performance of the electric field increased only slightly, thus reducing 
the effect size in more than one standard deviation in some cases. The recognition of 
the visual-evoked responses of Exp. 11 was the case for which this reduction was more 
significant. 

Recognizing vowels from syllables was the most challenging task encountered in 
our study. The comparatively low rates achieved in this case were possibly related to 
variations in the onset of vowels preceded by different consonants. As long-duration 
consonants take longer to be perceived as compared to short consonants, the onset of 
the ensuing vowel varied affecting the recognition negatively. Evidence of variations in 



onset was reported, for instance, by Lawson and Gaillard ( 1981 1 based on the analysis 
of evoked potential. 

Although the approximation (|8]l for the field normal component was obtained as- 
suming the spherical head model, there appears no major difficulty in extending this re- 
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suit to more realistic geometries at first sight, e.g., the slightly more realistic ellipsoidal 
scalp model. Also, experimental results pointed out that the electrical conductivity of 
the scalp has a prominent directional dependency that requires a representation of the 
scalp conductivity as a 2nd-rank; symmetric tensor ( Abascal et al 2008 Petrov 2012| l. 



Specially important is the tangential:radial anisotropy ratio of about 1.5, which would 
be accounted for by writing 

^scalp ^ ^scalp.. ^ ^scalp^^ ^ a/^^' (16) 

where ff^'^^'^ and a,'^^^'^ are real-valued conductivities along radial and tangential direc- 
tions. However, the only change in (|8]l due to ( fTS] ) is the multiplication of V^^j.j«l> by 
the ratio a/'^^'^'/dr'^^'P « 1.5, which has no practical effect on the recognition rates. 
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